🕷️️ Job Radar • SCRAPING

freelancer.com 2026-04-26 🟢

🔹 Build structured database of oil & gas service companies in Africa, Middle East, and Caribbean
👤 Client: 🇬🇧 LONDON, United Kingdom Member since 2018-02-20
💰 Price: $406 Average bid
🚩 Problem: Need to gather comprehensive and verified information from multiple sources for a large-scale database.
📦 Existing: Not specified

Specifications:

[Target] Collect data on 10,000+ oil & gas service companies
[Method] Scrape online directories, Google search results, public databases (Yellow Pages, Oil & Gas Journal, Kompass)
[UI/UX] N/A - Data-driven project
[Stack] Python, Apify, Scrapy, BeautifulSoup
[Security] Ensure data privacy and handle sensitive information securely
[Format] CSV or JSON with deduplication

Workflow:

1. Define scraping scope and sources (Yellow Pages, Oil & Gas Journal, Kompass, etc.)
2. Develop scraper using Python, Apify, Scrapy, BeautifulSoup for data extraction
3. Implement deduplication logic to ensure unique records
4. Verify data by cross-checking multiple sources or company websites
5. Format data consistently (Company name, Country, Service category, Website, Phone, LinkedIn page, Source URL, Date added)
6. Deliver batches of 500-1,000 lines